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ABSTRACT 

Project Data Tech targeted Spanish- and 
Hai t ian-spsaking students of limited English proficiency at a high 
school in Brooklyn. Students who were admitted scored at or below the 
40th percentile on the Language Assessment Battery, vere new arrivals 
into the country, and wanted to join the computers-aided drafting 
(CAD) or cosmetology programs. Students received instruction in 
English as a Second Language, native language arts (NLA), and 
bilingual content area subjects. The design included 
non-instructional services such as guidance, job placement, 
extracurricular activities, and family assistance. The project served 
78 male and 97 female students, with gender not reported for 5. 
Evaluation under Title VII of the Elementary and Secondary Education 
Act indicated that, for the most part, the project carried out the 
activities proposed in its design. Computer training was effective; 
and tutoring was available in English, NLA, and mathematics. A Parent 
Advisory Council breakfast meeting was held monthly for parents of 
project students. Objectives were met in most areas, but objectives 
for English and career placement were not met. Recommendations are 
made for program improvement. Appendix A ^escribes data collection 
and analysis, and Appendix B describes instructional materials. 
(SLD) 
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FOREWORD 



The body of this report is preceded by an Extract which presents aa overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of ail objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

Tlie extract is followed by the body of ihe report, litled Program Assessment. This includes such 
information as staffing, program implemeniaiion, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have specifically 
staled objectives. This may be information on aticndance and dropout rate, grade retention, 
mainstreaming, referrals oat of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in Appendix A following the text. 
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EXTRACT 

FUNDING CYCLE: Year 3 of 3 
SITES 

Enrollment* 



(fall) 
165 



(spring) 
160 



*The projeci enrolled 180 students (10 less than in ilie previous year), serving 165 in the fall and 160 in the 
spring. Male students numbered 78, female 97; gender was :iot reported for 5. 



STUDENT BACKGROUND 
Native Language Number of Students 



Haitian 
Spanish 



102 
78 



Number of Siudents 

102 
40 
12 
5 
4 
4 
4 
3 
3 
1 
1 



Countries of Origin 
Haiti 

Dominican Republic 
Puerto Rico 
Nicaragua 
El Salvador 
Mexico 
Panama 
Colombia 
Honduras 
Bolivia 
Costa Rica 

Median Years of Education in Native Country: 8.0; in the United States: 2.0 

Percentage of Students Eligible for Free Lunch Program: 91.7 

ADMISSION CRrrERL\ 

The project admitted students who scored at or below the 40ih percentile on the Language Assessment 
Battery (LAB), were new arrivals into the country, and wanted to join the computer-aided drafting (C^M)) or 
cosmetology programs. 

PROGRAMMING 

Design Features 

Project Data Tech targeted Spanish- and Haitian-speaking students of limited English proficiency (LLP) 
at Sarah J. Hale High School in Brooklyn. Participating siudents majored iu either CAD or cosmetology while 
receiving instruction in English as a Second Language (E.S.L.), Native Language Arts (N.L.A.), and bilingual 
content area subjects. The design included non-instructional services such as guidance, job placement, 
extracurricular activities, guidance, and family assistance. 



Capacity building. In ihe next year, lax levy funds will support the position of the paraprofcssional. 
When Title VII funding ends, lax levy funds will also assume support of the curriculum specialist and ihe project 
director so that program services will be maintained. 

Strengths and Limitations 

For the most part, Project Data Tech carried out those activities proposed in its design. Students were 
effectively trained in the use of computers and used computer-aided instruction across the curriculum. Tutoring 
in E.S.Lm N.L.A., and mathematics was available both before and after school. Project students participated in 
such extracurricular activities as soccer, baseball, and an executive internship program. A Parent Advisory 
Council (PAC) meeting and breakfast was held monthly for parents of project students. 

Tlie project director reported that a trilingual guidance counselor was necessary to serve the multilingual 
population of the school. She also felt that the availabiliK of French and Haitian high school level text books was 
limited, restricting the project students' potential academic progress. 

CONCLUSIONS AND RECOMMENDATIONS 

As it had done last year, Project Data Tech met its objectives for N.L.A., content area subjects, 
attendance, and staff and curriculum development. Tlie project met its objective for dropout prevention although 
it had not done so the previous year. It met its objective for enrollment in post-secondary institutions; last year 
OREA had been unable to evaluate that objective. 

Although students showed a significant increase in F-!nglish language proficiency, as in the previous year, 
Project Data Tech failed to meet the objective for E.S.L. Flie percentage of students showing a gain was greater 
in the current year than it had been last year. This year. Project Data Tech did not meet the objective for career 
placement; last year there was no comparable objective. 

OREA was unable to evaluate the objectives for content area subjects as assessed by passing rates on 
Regents exams; there was no comparable objective last year. It was also unable to evaluate the objective for 
special education referrals, gifted and talented programs, or parental involvement because of a lack of data. In 
the previous year, the project failed to meet the objective for special education referrals and placement in gifted 
and talented programs, and met its objective for parental involvement. 

Tlie conclusions, based on the findings of this evaluation, lead to the following recommendations: 

• Explore ways of enhancing the development of English language skills, possibly with such techniques 
as small group and individual instruction and peer tutoring. 

• Augment the career placement services of the program by compiling a list of contacts in the desired 
career area, working with students on job application and interview skills, and offering follow-up 
services so as to maintain good relationships \sith current and prospective employers. 



• Provide all required data so that all objeciivos can be evaluated. 



PROGRAM ASSESSMENT 



STAFFING 

Title VII Staff (Total 3) 

Title VII Funding 
Full time 
Full time 
Full time 



Title Decree Language Competencies 

Project Director M.A., P.D. Spanish, French 

Computer Specialist B.S. French, Haitian 

Paraprofessional B.S. Spanish 



Other Staff Working With Project Students (Total 32) Tlie project did not provide data on the titles, highest 
'educational degrees obtained, language competencies, or teaching/communicative proficiencies* of non-Title 
Vll-funded staff. " 



Certification 



Guidance I 

French 2 

Industrial Arts I 

E.S.L. 3 

Spanish 3 

Mathematics 4 

Social Studies 2 

Bilingual Spanish 2 

Cosmetology I 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
En glish as a Second Language (E.S.L.) 

E.S.L. CLASSES 



High School Level Periods Weekly Students Enrolled 

Sarah J. Hale Literacy 5 16 

Beginning 10 15 

Intermediate 5 34 

Advanced 5 30 

Transitional 5 26 



E.S.L. teachers used a whole-text, holistic teaching methodology. Students were encouraged to create 
their own literary worlts and the CAD teacher instructed students in how to use a word processing program to 
check English grammar. In addition, audio-lingual instruction was utilized to develop skills of listening and 
speaking. For a list of instructional materials, see Appendix B. 



Teaching Proficiency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 
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• Eighty-five percent of the target students will demonstrate an appropriate increase in EngHsh 
language proficiency. 

Evaluation Instrument: Language Assessment Battery (LAB)* 

Pretest: May 1991; posttest: May 1992. 

Number of students for whom pre- snd posttest data were reported: 113 

Percent of students with pretest/posttest gains: 61.9 

Mean gain: 7.5 N.C.E.s ,s.d.=9.3) 

Mean gain is statistically significant (f=8.54, p<.Q5), 

Although students showed a sizable and statistically significant mean gain from pretest to posttest on the 
LAB, less than the projecierl 85 percent demonstrated an improvement. 

Project did not mnet E.S.L, objective. 

Native Language Arts fN.L,A.^ 

Students demonstrating iack of native language literacy skills (estimated): 90 percent. 

N.L.A. CLASSES (Spanish and Haitian) 

Level Periods Weekly Students Enrolled 

Beginning 5 Not provided 

Intermediate 5 

Advanced 5 

Advanced Placement 5 

N.L.A. teachers used a holistic approach by focusing on instructional topics and materials based on the 
students' cultural heritage. For a hst of instructional materials, see Appendix B. 

• As a result of participation in the program 75 percent of the studenis will demonstrate a significant 
increase in Haitian Creole language achievement. 

• As a result of participating in the program, 75 percent of the students will demonstrate a significant 
increase in Spanish language achievement. 

Evalnation Indicator: final course grades. 



High School 
Sarah J. Hale 



*OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
normed. Test scores are reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores 
with a mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in 
N.C.E.s in the absence of supplementary instruction and that participating students* gains are attributable to 
project services. 
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PASSING GRADES IN NATIVE LANGUAGE ARTS 



Enrollment Percent Passing 

Language Fall Spring Fall Sprint^ 

Haitian Creole 57 53 lOO.O lOO.O 

Spanish 53 53 100.0 100.0 



Project met N.LA. objective. 



Content Area Subjects 

Project students took courses in mathematics, science, social studies, and CAD or cosmetology. Courses 
were taught biiingually or with an E.S.L. approach. Computers, drafting equipment, teacher-made worksheets, 
transparencies, videotapes, and audiocasettes were used. For a list of instructional materials, see Appendix B. 

• Program students will have passing rates on translated versions of the Regents examinations in Spanish, 
Trench, and American Studies that are equal to or higher than those of mainstream students. 

Evaluation Instrument: New York Slate Regents Examinaiions 

Project did not provide data on the passing rates of cither program or mainstream students. 

OR£A could not evaluate content area subject Regents exam objective. 

• At least 85 percent of the students eiuoilcd in maihematics, science, and social studies will score at or 
above the passing criterion of 65, 

• At least 70 percent of the students enrolled in Computer-Aided Drafting^'Dcsign courses will sctuc at 
or above the passing criterion of 65. 

Evaluation Indicator: final course grades. 

PASSING GRADES IN CON IliNT AREA COURSES 



High School l-'all Spring 

Subject Enrollment Percent Passing Enrollment Percent Passing 

Sarah J. Hale Mathematics 155 100.0 150 lOO.U 

Science 137 100.0 132 100.0 

Social Studies 162 100.0 156 100.0 

Computers/CAD 29 100.0 27 100.0 



Project met conttnt area subject objective for inuthemutics, science, social studies, and CAD/design. 



Career Placement 

• Seventy-five percent of the students who have parlicipated in the program will be placed in a 
computer-aided drafting/design oriented placement. 

Evaluation Indicator: program records. 

The project placed one student in a CAD/design position. Although the project did not meet this 
objective, it was reported that many of the graduating students planned to further their education. 

Project did not meet career placement objective. 



Attendance 



Family assistants visited the homes of students who were frequently absent. The project was also part of 
an International House Plan which emphasized good attendance and met with parents to discuss their children's 
progress. 

• As a result of participating in the program, sludents' aitendance will be 10-15 percent higher than 
mainstream students*. 

Evaluation Indicator: school records. 

ATllZNDANCE RATES 
High School Project Students Mainstream Students 

Sarah J. Hale 96.0 74.9 

V<.05 

Project met attendance objective. 

Dropout Prevention 

• The percentage of dropouts for target students will be 10-15 percent less than mainstream dropouts. 
Evaluation Indicator: school records. 

DROPOUT RATCS 

High School Project Students Mainstream Students Diffcrcni-c 

Sarah J. Hale 0.0 5.9 5.9* 

V<.05 

Project met dropout prevention objective. 

Special Education Referrals and Grade Retention 

• Tlie percentage of student grade retention, referral to, or placement in special educntion will be 10-15 
percent less than the mainstream. 

Evaluation Indicator: school records. 

No project students were placed in or referred to special education programs. Only two students 
(1.1 percent of participants) were retained in grade. Referral rate and grade retention figures for mainstream 
students were not available. 

ORI:IA was unable to evaluate specifii education referrals and grade retention objective because of a luck 

of data* 



Dirference 
21.1' 




Enrollment in Post -secondary Institutions 

• At least 85 percent of the students who are graduating will continue post high school training or 
advancement. 

Evaluation Indicator: program i-ecords. 

Of the 62 students eligible for graduaiion 54 (87.1 percent) reported that they were interested in post- 
high school training or continuing their education* 

Project met enroL^ment in post-secondary institutions objective. 

Gifted and Talented Programs 

Project Data Tech offered students who were considered to be gifted and talented the opportunity to 
participate in Regents and leadership classes. 

• Placement in programs for the gifted and talented will be 10-15 percent greater than mainstream 
students. 

Evaluation Indicator: school records. 

No students were referred to gifted and talented programs. Figures for mainstream students were not 
available. 

OR£A could not evaluate gifted and talented program objective* 
Mainstreaming 

Project students who were mainstreanied remained in a bilingual official class. Their records were 
frequently reviewed by the guidance counselor. No students were niainstreamed in the current year. 

The project did not provide any data on the academic achievement of former project students who had 
been mainstreamed. 

Staff Development 

• Ninety percent jf program staff will denionstrijte professional growth by completing course of study. 

Evaluation Indicator: program records. 

According to the project director, all program siulf demonstrated professional growth by compleiing 
inservice and/or college/university courses. 

Project met staff development objective. 
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Curriculum Developmerit 



• Courses of study will have been revised and reviewed to meet the ne^ds of Hispanic and Haitian 
students in the following areas: Applied E.S.L. Levels I and II; N.L.A. skills; New York City Public 
Schools curriculuin in the area of Computer- Aided Drafting/Design in Spanish and Haitian Creole. 

Project staff and participating teachers reviewed and revised all proposed courses of study: translated 
social studies, mathematics, and science materials; and integrated revised and translated materials into the 
curriculum. 

Project met curriculum development objective* 

Parental Involvement 

• Parents of project students will demonstrate more parental involvement that parents of mainstream 
students by demonstrating a 10-15 percent higher attendance at school functions. 

Evaluation Indicator: program records. 

Although it was reported that parents attended monthly PAC meetings and breakfasts and Parent- 
Teacher Association (P.T.A.) meetings, the project failed lo provide any attendance rates. 

OR£A was unable to evaluate parental involv«fni(:nt objective. 



APPENDIX A 



DATA COLLECTION AND ANALYSIS 



COLLECTION 

OREA evaluation consultants visit sites and interview key personnel. The project director gathers data 
and, with the consultant, completes forms (as shown below) as necessary. 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstreamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

Tlie Project Director's Questionnaire includes questions on staff qualifications, program implementation, 
periods of instruction, and instructional materials and icchniques. 

Project Director's Interview 

The interview gathers information on prograni and student or staff characteristics not supplied by the 
Project Director's Questionnaire. Tlie interview also allows project staff to offer qualitative data or amplify 
responses to the questionnaire. 

Citvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (L,AE) and other cii^-wide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.CE.s). N.C.E.s are 
normalized standard scores with a mean of 50 and a standard deviation (s.d.) of 21.06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. Again of 5 N.C.E.s is the same 
whether it is at the lower or the higher end of the scale. N.C.T.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although mure familiar to many, are unsuitable for such computations 
since they are not equal-interval.) 

Likert'Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, arc used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). Tliey also assess staff and parent attitude and reactions to workshops and other 
activities. 



ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficienc7 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. Scores are 
reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 21.06. (See "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a r- 
test. To test whether a difference between two proportions (e.g., program and mainstream attendance rales) is 



greater than could be expected by chance, OREA uses a z-iesi and reports the differences between the two 
proportions. The level of significance is set at .05 for all tests. 

Techniques For Mininiizing_ErTor 

The evaluation procedures minimize error by providing for proper administration of evaluation 
instruments through a combination of testing at 12-month intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above), the Degrees of Reading Power (D.R.P.) test, 
ihe Metropolitan Achievement Test-Maihemaiics (MAT-Math), El Examen de Lectura en Espanol (ELE), 
Likert-lype scales (see above), and project -developed tests. Except for Likert scales and project-developed tests, 
these instruments are scored on a citywide basis at the Scan Center of the New York City Public Schools. 



APPENDLX B 



INSTRUCTIONAL MATERIALS 



E.S.L. 

A Conversation Book I 

English for a Changing World: Book 11 

English With a Smile: Book f 



Spanish 

Unamuno, Miguel de. Niebla 

Asturas, Miguel Angel. El Senor Presidenie 

Cervantes, Miguel de. Novelas EjempUires 



Mathematics 

Dressier and Keen an. Iniegraicd Maihenuiiics Course I 
Science 

Lesser. Life Science 

Marshall and Bunch. Physical Science 

Social Studies 

Comprende Tu Mundo 
Su Historia v Culturas 
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